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DESCRIPTION 



Voice Attachment Control Apparatus and 
Voice Attachment Control Method for Construction Machine 

5 

Technical Field 

This invention relates to a voice attachment control 
apparatus and a voice attachment control method for a 
construction machine suitable for use, for example, with 
10 a hydraulic excavator for excavating the ground or a like 
machine . 

Background Art 

Generally, a construction machine such as a hydraulic 

15 excavator has a construction wherein it includes an upper 

revolving unit with an operator cab (cabin) provided on 
a lower traveling body having caterpillar members , and 
further, a joint type arm mechanism composed of a boom, 
a stick and a bucket is provided on the upper revolving 

20 unit. 

Not only the bucket but also various attachment 
elements (which may hereinafter referred to merely as 
attachments) are attached to an end portion of the stick 
in accordance with a working application of the 
25 construction machine. 

FIGS. 6(a) and 6(b) are schematic views of different 
attachments, respectively. The attachment shown in FIG. 



6(a) is a bucket used principally for excavation, and the 
attachment shown in FIG. 6(b) is a shear. The shear can 
perform a movement of grasping an object and a rotational 
operation, and, for example, can grasp and rotate a steel 
frame or the like and shear the steel frame . Also a hammer 
(not shown) or the like can be attached, and the attachment 
to be attached to the stick can be replaced selectively 
from among various attachments in accordance with a working 
application. 

FIG. 7 is a schematic diagram of functional blocks 
of an electronic control apparatus. The electronic 
control apparatus (controller) 50 shown in FIG. 7 is a 
control apparatus for operating movements of a hydraulic 
excavator and an attachment and includes a machine body 
control means 50a. The machine body control means 50a is 
connected to attachment switches 6a, 6b, an operation lever 
(Joystick) 6, pedals 9a, 9b, an ON/OFF valve 13, a solenoid 
proportional valve 3 and so forth. 

The attachment switches 6a, 6b are switches for 
starting/stopping the attachment, respectively, and the 
operation lever 6 is provided to operate the machine body. 
In addition, the pedals 9a, 9b are provided to move the 
machine body f orwardly/backwardly to the left side and 
called modulation pedals or attachment input modulation 
pedals. The position of the operation lever 6 and the 
positions of the pedals 9a, 9b adjusted by the operator 
(which may be hereinafter referred to as operating person) 



are read in by the electronic control apparatus 50. 

The ON /OFF valve 13 is a main control valve and 
controls movement of actuators (hydraulic cylinders). 
The solenoid proportional valve 3 uses hydraulic pressure 
to control the spool position of the ON/OFF valve 13. 

Thus, control of the attachment (hammer, shear or 
the like) of the conventional hydraulic excavator is 
performed through the ON/OFF switch provided at an upper 
portion of the operation lever 6 or the pedals 9a, 9b. 

FIG. 8 is a schematic view of the operation lever 
6, and the operation lever 6 is tilted in the forward, 
backward, leftward or rightward direction by operation 
of the operator . If the operator tilts the operation lever 
6, then the tilted position of the operation lever 6 is 
read in by the machine body control means 50a (refer to 
FIG. 7) and the solenoid proportional valve 3 is adjusted. 

The attachment switch (for starting) 6a and the 
attachment switch (for stopping) 6b are provided at an 
upper portion of the operation lever 6 shown in FIG. 8. 
If the operator depresses the attachment switch 6a, then 
the machine body control means 50a adjusts the ON /OFF valve 
13 to start movement of the attachment. Similarly, if the 
operator depresses the attachment switch 6b, then the 
movement of the attachment is stopped. 

FIG. 9 is a schematic view of the pedal 9a (or pedal 
9b). If the operator operates the pedal 9a, then the 
direction of movement of the pedal 9a is adjusted, and 



consequently, operation of the attachment is performed. 

The prior art, however, has a subject to be solved 
in that it imposes a very heavy burden on the operator 
for the operator to operate the attachment while such 
operations as operations of the boom, stick, bucket and 
upper revolving unit for pivoting and revolving movements 
are performed. 

The present invention has been made in view of such 
a subject as described above, and it is an object of the 
present invention to provide a voice attachment control 
apparatus and a voice attachment control method for a 
construction machine such as a hydraulic excavator which 
uses, in order to control an interlocking movement by a 
plurality of actuators, voice to control an attachment 
in starting, stopping and speed adjustment to improve the 
safety of the working person. 

Disclosure of Invention 

In order to attain the object described above, 
according to an aspect of the present invention, a voice 
attachment control apparatus for a construction machine 
which has an attachment element as a construction working 
member connected to actuators is characterized in that 
it comprises speech analysis means for speech-analyzing 
a voice command representative of an instruction by voice 
regarding a movement of the attachment element , speech 
discrimination means, connected to the speech analysis 



means, for discriminating the instruction of the voice 
command, and machine body control means, connected to the 
speech discrimination means, and operable of controlling 
movement of the attachment element based on the 
instruction. 

Accordingly, with the voice attachment control 
apparatus , the operator can operate the attachment element 
by voice. Further, the operator can concentrate its 
attention upon operation of a boom, a stick and a bucket 
which are principal ones of the actuators and operation 
for revolving motion. 

The machine body control means may set values 
relating to amovement position and a speed of the attachment 
element or may include speech synthesis means for conveying 
a working situation of the attachment element to an operator 
of the construction machine. 

The machine body control means may set values 
relating to a movement position and a speed of the attachment 
element, or may include speech synthesis means for 
conveying a working situation of the attachment element 
to an operator of the construction machine. 

Accordingly, with the voice attachment control 
apparatus, starting, stopping and speed change of the 
attachment element can be performed, and also in this 
instance, the operator can concentrate its attention on 
operation of another actuator, resulting in the advantage 
that the safety is improved. 



According to another aspect of the present invention , 
a voice attachment control method for a construction 
machine is characterized in that it comprises, in order 
to operate a shear connected to actuators and operable 
of performing a movement of grasping an object and a 
rotational movement as an attachment element as a 
construction working member, a first movement step of 
speech-analyzing a voice command representative of an 
instruction by voice regarding a movement of the attachment 
element to discriminate the instruction of the voice 
command and performing a first movement of the actuators, 
a stopping step of stopping the shear once after the first 
movement step, and a second movement step of 
speech-analyzing, after the stopping step, another voice 
command to discriminate a second instruction of the voice 
command and performing a second movement of the actuators 
based on the second instruction. 

Accordingly, with the voice attachment control 
method, the operator need not utter a starting command 
for a rotational operation or a grasping operation any 
more . 

According to a further aspect of the present 
invention, a voice attachment control method for a 
construction machine is characterized in that it comprises , 
in order to operate a shear connected to actuators and 
operable of performing a movement of grasping an object 
and a rotational movement as an attachment element as a 



cons truct ion working member , an interlocking movement step 
of speech-analyzing a voice command representative of an 
instruction by voice regarding an interlocking movement 
of the attachment element which includes a plurality of 
movements to be performed simultaneously to discriminate 
the instruction of the voice command and performing the 
interlocking movement of the actuators based on the 
instruction. 

Accordingly, with the voice attachment control 
method , where a shear is attached as the attachment element , 
the operator can perform a rotational operation and a 
grasping operation simultaneously through a voice command 
representative of an interlocking movement of a plurality 
of movements , resulting in the advantage that the 
operability is improved. 

Brief Description of the Drawings 

FIG. 1 is a schematic view showing a configuration 
of a hydraulic excavator according to an embodiment of 
the present invention; 

FIG. 2 is a functional block diagram of an electronic 
control apparatus according to the embodiment of the 
present invention; 

FIG. 3 is a flowchart illustrating voice attachment 
setting according to the embodiment of the present 
invention; 

FIG. 4 is a flowchart illustrating speed adjustment 



of a shear according to the embodiment of the present 
invention; 

FIG. 5 is a flowchart illustrating continuous 
operation of the shear according to the embodiment of the 
present invention; 

FIGS. 6(a) and 6(b) are schematic views of different 
attachments respectively; 

FIG. 7 is a schematic view of functional blocks of 
an electronic control apparatus; 

FIG. 8 is a schematic view of an operation lever; 

and 

FIG. 9 is a schematic view of a pedal. 

Best Mode for Carrying Out the Invention 

(A) Description of the First Embodiment of the 
Present Invention 

In the following, an embodiment of the present 
invention is described with reference to the drawings. 

FIG. 1 is a schematic view showing a configuration 
of a hydraulic excavator according to an embodiment of 
the present invention. A hydraulic excavator 80 (which 
may be hereinafter referred to merely as machine body) 
shown in FIG. 1 is a construction machine having an 
attachment as a construction working member connected to 
actuators. The hydraulic excavator 80 includes a lower 
traveling body 500 having caterpillar members 500A on the 
left and right thereof, and a upper revolving unit 100 



with an operator cab 600 provided for revolving motion 
within a horizontal plane on the lower traveling body 500. 

A boom 200 having one end connected for swinging 
motion is provided on the upper revolving unit 100, and 
a stick 300 connected at one end thereof for swinging motion 
by a joint part 21 is provided on the boom 200. Further, 
a shear 401 which is connected at one end thereof for 
swinging motion by a joint part 22 and can excavate the 
ground with a tip thereof and accommodate earth and sand 
therein is provided on the stick 300. The boom 200, stick 
300 and shear 401 cooperatively form a joint type arm 
mechanism. 

Further, a boom hydraulic cylinder 120, a stick 
hydraulic cylinder 121 and a bucket hydraulic cylinder 
122 are provided as cylinder type actuators. It is to be 
noted that, in the following description, the boom 
hydraulic cylinder 120 is sometimes referred to as cylinder 
120, the stick hydraulic cylinder 121 as cylinder 121, 
and the bucket hydraulic cylinder 122 merely as cylinder 
122. 

The boom hydraulic cylinder 120 is connected at one 
end thereof for swinging motion to the upper revolving 
unit 100 and is connected at the other end thereof for 
swinging motion to the boom 200. In other words, the boom 
hydraulic cylinder 120 is interposed between the upper 
revolving unit 100 and the boom 200, such that, as the 
distance between the opposite end portions thereof is 
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expanded or contracted, the boom 200 can be swung with 
respect to the upper revolving unit 100. 

The stick hydraulic cylinder 121 is connected at 
one end thereof for swinging motion to the boom 200 and 
5 connected at the other end thereof for swinging motion 
to the stick 300. In other words, the stick hydraulic 
cylinder 121 is interposed between the boom 200 and the 
stick 300, such that, as the distance between the opposite 
end portions thereof is expanded or contracted, the stick 
10 300 can be swung with respect to the boom 200. 

The bucket hydraulic cylinder 122 is connected at 
one end thereof for swinging motion to the stick 300 and 
connected at the other end thereof for swinging motion 
to the shear 401. In other words, the bucket hydraulic 

15 cylinder 122 is interposed between the stick 300 and the 

shear 401, such that, as the distance between the opposite 
end portions thereof is expanded or contracted, the shear 
401 can be swung with respect to the stick 300. It is to 
be noted that a linkage mechanism 130 is provided at a 

20 free end portion of the bucket hydraulic cylinder 122. 

In this manner, a cylinder type actuator mechanism 
having a plurality of cylinder type actuators for driving 
the arm mechanism by performing expanding or contracting 
operations is composed of the cylinders 120 to 122 described 

25 above . 

In the operator cab 600 shown in FIG . 1 , the operation 
levers 6, 8, a monitor 10, an operation panel 60 with a 
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key pad ( also referred to as operation panel ) , a microphone 
61, a speaker 62 and so forth are provided. The operation 
lever 6 is used for position adjustment of the stick 300 
and revolving motion of the upper revolving unit 100 . The 
operation lever 8 is used for position adjustment of the 
boom 200 and the shear 401. Each of the operation levers 
6 , 8 is tilted to a forward, a backward or a neutral position 
or to a leftward, a rightward or a neutral position by 
the operator to perform the position adjustment. 

Further, an electronic control apparatus 1 is 
provided in the inside of the upper revolving unit 100 
shown in FIG. 1. FIG. 2 is a functional block diagram of 
the electronic control apparatus 1 according to the 
embodiment of the present invention. The electronic 
control apparatus 1 shown in FIG. 2 is a voice attachment 
control apparatus for a construction machine and controls 
the boom 200, stick 300 and shear 401 to effect desired 
expansion/contraction displacements in accordance with 
a mode in which the operator wants to control them. 

The electronic control apparatus 1 includes a speech 
analysis means la, a speech discrimination means lb, a 
machine body control means lc and a speech synthesis means 
Id. It is to be noted that the electronic control apparatus 
1 is composed of a microprocessor, memories such as a ROM 
(Read Only Memory) and a RAM (Random Access Memory), 
suitable input /output interfaces and so forth. 

The speech analysis means la performs speech analysis 
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of a voice command representative of an instruction by 
voice relating to a movement of the attachment, and this 
function is implemented, for example, by software or 
hardware. The speech analysis means la receives an input 
of a voice command signal of the operator obtained by the 
microphone 61 and performs speech processing of the voice 
command signal. The speech discrimination means lb is 
connected to the speech analysis means la and discriminates 
the instruction of the voice command, and is implemented, 
for example, by software. 

The voice command signifies an instruction such as 
"boom up", "stick in" or "bucket close" uttered by the 
operator. 

The machine body control means lc is connected to 
the speech discrimination means lb and can control the 
movement of the attachment in accordance with the 
instruction, and this function is implemented, for example, 
by software. The machine body control means lc is 
connected to the operation levers 6, 8 and is connected 
also to the ON/ OFF valve 13 and the solenoid proportional 
valve 3 . 

The machine body control means lc sets values 
regarding the movement position and the speed of the 
attachment element, and the setting upon movement of the 
attachment is performed by voice. The setting contents 
include CD maximum and minimum flow rates to be allocated 
to the attachment, (D maximum and minimum electric currents 
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to the attachment solenoid proportional valve and a maximum 
engine speed, ® a maximum acceleration dial and speed 
changeover level, and ® a speed modulation. 

The speech synthesis means Id conveys a working 
5 situation of the attachment to the operator of the machine 
body and is implemented, for example, by software or 
hardware . 

Consequently, if the operator utters a voice command 
relating to an operation of the attachment, then the voice 

ok 

3 10 command is converted into a voice signal by the microphone 
'4 61 and speech-processed by the speech analysis means la. 

,5 Then, the speech discrimination means lb extracts an 

jf instruction such as "boom up" regarding an operation of 

;2 tne attachment from the speech-processed voice command, 

2 15 and the machine body control means lc controls the movement 
of the attachment based on the instruction of "boom up", 
y Further, the positions of the operation levers 6, 

8 tilted by the operator are read in by the machine body 
control means lc, and the ON/OFF valve 13 and the solenoid 
20 proportional valve 3 are controlled so that they may 
individually perform suitable movements. More 
particularly, the ON/OFF valve 13 and the solenoid 
proportional valve 3 operate so that the shear 401 performs 
a cutting movement or a rotational movement. 
25 Regarding a voice attachment control method for a 

construction machine of the present invention having the 
configuration described above, setting before starting 
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is described with reference to FIG. 3 and control of the 
shear 401 is described in detail with reference to FIGs. 4 
and 5. 

FIG. 3 is a flowchart illustrating voice attachment 
setting according to the embodiment of the present 
invention. First, the operator will utter "attachment 
setting" before starting (step Al) . Here, the speaker 62 
communicates "maximum flow rate, please" (step A2 ) , and 
the operator will utter, for example, "100 litter per 
minute" (step A3) . Then, the speaker 62 communicates "dial 
level of maximum engine speed, please" (step A4), and the 
operator will utter, for example, "dial 5" (step A5). 
Further, the speaker 62 communicates "speed changeover 
level, please" (step A6 ) , and the operator will utter, 
for example, "level 3" (step A7). Then, the speaker 62 
communicates "attachment setting completed" thereby to 
complete the attachment setting (step A8). 

FIG. 4 is a flowchart illustrating speed adjustment 
of the shear 401 according to the embodiment of the present 
invention. First, if the operator utters "start shear" 
(step Bl), then the shear 401 starts its movement (step 
B2). Then, while no voice command by the operator is 
inputted, the processing passes the NO route of step B3, 
but if a voice command is inputted, then the processing 
passes the YES route of step B3 and advances to step B4 
denoted by 1 or to step B5 denoted by 2 . In step B4 , if 
the speech discrimination means lb discriminates that the 
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operator has uttered "fast" , then the machine body control 
means lc raises the speed of rotation of the shear 401. 
In step B5, if the speech discrimination means lb 
discriminates that the operator has uttered "slow", then 
the machine body control means lc lowers the speed of 
rotation of the shear 401. Then in step B6 , it is 
discriminated whether or not the stop command by the 
operator is inputted. While the stop command is not 
inputted, the processing passes the NO route, and the 
processes beginning with step B3 are repeated. On the 
other hand, if the operator utters the stop command in 
step B6, then the processing passes the YES route, and 
the shear 401 is stopped in step B7 . 

Now, control of the shear 401 when another operation 
is performed continuously during movement of the shear 
401 is described with reference to FIG. 5. FIG. 5 is a 
flowchart illustrating continuous operation of the shear 
401 according to the embodiment of the present invention. 

First, if the operator utters "start sear" (step 
Cla), then the shear 401 starts its rotational movement, 
and in order to grasp an object, a suitable hydraulic 
pressure is applied to make preparations for the movement . 
Further, if the rotation of the shear 401 is 
rightward/ leftward rotation, then the speaker 6 2 
communicates "rightward rotation" /"leftward rotation" in 
step C2a/step C2b, respectively. In this state, the 
processing passes a route denoted by L and returns to step 
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Clb. 

Here, if the operator utters "fast"/"slow" (step 
C2c/step C2d) , then the speed of rotation of the shear 
401 is increased/decreased, and then the processing 
returns to step Clb. 

If the operator utters "grasp "/"release" (step 
C2e/step C2f", then the shear 401 grasps or release, for 
example, a steel frame, whereafter the processing returns 
to step Clb. 

If the operator utters "right grasp" (step C2g) , 
then the shear 401 moves the right side grasping portion 
thereof to grasp a steel frame while movement of the left 
side grasping portion thereof is kept stopped. Similarly, 
if the operator utters "left grasp" (step C2h) , then the 
shear 401 moves the left side grasping portion to grasp 
a steel frame while movement of the right side grasping 
portion is kept stopped. 

On the contrary, if the operator utters "right 
release" (step C2i), then the shear 401 moves the right 
side grasping portion thereof to release the steel frame 
while the steel frame is kept grasped by the left side 
grasping portion of the two grasping portions . Similarly, 
if the operator utters "left release" (step C2j), then 
the shear 401 moves the left side grasping portion thereof 
to release the steel frame while the steel frame is kept 
grasped by the right side grasping portion. 

Then, if the operator utters "stop" (stepC2k), then 
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the movement of the shear 401 is stopped temporarily. If 
the operator utters "stop shear" (step C3) , then the shear 
401 stops its movement completely. Thus, while the shear 
401 is moving, the voice command of "stop" signifies 
5 temporary stopping of the shear 401 but does not signify 
complete stopping. 

Accordingly, in the voice attachment control method 
for a construction machine of the present invention, when 
the shear 401 connected to the actuators and operable of 

f 10 performing a movement of grasping an object and a rotational 

13 

^ movement as an attachment element as a construction working 

0 member is to be operated, a voice command representative 

t 

,FI of an instruction by voice regarding a movement of the 

3 attachment element is speech- analyzed to discriminate the 

% 15 instruction of the voice command, and a movement (for 

;5j example, right grasp) of the actuators based on the 

- instruction is performed (first movement step). 

After the first movement step, the shear 401 is 
stopped once (stopping step). 
20 After the stopping step, another voice command is 

speech-analyzed to discriminate a second instruction of 
the voice command and a second movement ( for example , right 
release) of the actuators based on the second instruction 
is performed (second movement step). 
25 In this manner, where the shear 401 is attached as 

the attachment , when another sole operation is to be started 
after the operator stops its operation once , a voice command 
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inputting operation for starting every time is not required 
and the operator can directly utter a voice command for 
movement to cause the shear 401 to move. 

Also it is possible to combine a plurality of 
operations in order to eliminate the complexity involved 
in individual utterances of different movements of the 
shear 401. 

In particular, the voice attachment control method 
for a construction machine of the present invention 
includes, in order to operate the shear 401 connected to 
the actuators and operable of performing a movement of 
grasping an object and a rotational movement as an 
attachment element as a construction working member, an 
interlocking movement step of speech-analyzing a voice 
command representative of an instruction by voice 
regarding an interlocking movement which includes a 
plurality of movements of the attachment to be performed 
simultaneously to discriminate the instruction of the 
voice command and performing an interlocking movement of 
the actuators. 

Since the shear 401 is operated in composite 
operations of an operation for a movement of grasping a 
steel frame and an operation for a rotational movement 
in this manner, the number of voice commands to be uttered 
by the operator decreases and the burden on the operator 
decreases significantly. 

Thus, starting, stopping, speed adjustment and 
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setting upon movement of the attachment can be performed 
by voice in this manner. 

Further, when another sole operation is to be 
performed after the attachment is stopped once, the shear 
401 can be moved directly by uttering a voice command for 
the movement, and the complexity involved in utterance 
of the voice command for starting every time can be 
eliminated. 

Furthermore, for different operations through which 
a plurality of movement patterns are performed 
simultaneously like a rotational operation of the shear 
401 and a grasping operation of the shear 401, a voice 
command corresponding to an interlocking movement which 
includes the combination of the plurality of movements 
is prepared in advance. Therefore, the operator is 
released from the complexity in that all movements must 
be performed and can concentrate its attention only upon 
one movement. Accordingly, the working efficiency is 
improved significantly and the safety upon working is 
improved . 

Further, since a working situation of the attachment 
is conveyed to the operator through speech synthesis, the 
working efficiency of the operator is improved as well. 

It is to be noted that the present invention is not 
limited to the embodiment described above, and variations 
and modifications can be made without departing from the 
scope of the present invention. 
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The present invention is not limited to the hydraulic 
excavator 80 described above but can be applied to other 
construction machines with which, for example, both hands 
are used for their working operation. 

Industrial Applicability of the Invention 

As described above , according to the voice attachment 
control apparatus for a construction machine of the present 
invention, the burden on the operator can be reduced 
significantly, and the operator can concentrate its 
attention upon an operation of another actuator, which 
improves the safety. 

Further, according to the voice attachment control 
method for a construction machine of the present invention , 
the burden on the operator in excessive utterances is 
decreased. Furthermore, the operator can perform a 
rotating operation and a grasping operation simultaneously 
by which improvement in operability can be achieved. 



